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What happens when you combine high school and college? The impact of the early college 


model on postsecondary performance and completion! 


The U.S. economy is dramatically changing in the 21“ century with new, emerging 
careers, most of which will require some schooling beyond high school (Carnevale & 
Desrochers, 2003; Carnevale, Smith, & Strohl, 2010). Yet too many high school students do not 
enroll in and graduate from college. An estimated 70 percent of high school graduates 
immediately enter postsecondary education, and only about half of them (49 percent) attain some 
type of postsecondary credential within six years (Ross et al., 2012). The problems are 
particularly acute for students with fewer means (Bailey & Dynarski, 2011; Louie, 2007). For 
example, first generation college-goers are almost half as likely to go to college and to obtain a 
degree as students whose parents attended college (Redford & Hoyer, 2017). Bachelor’s degree 
attainment rates for Black and Hispanic students are approximately 20 percentage points lower 
than for white students (Ross et al., 2012). This means that many individuals are currently shut 
out of the opportunities and advantages that postsecondary education can bring. 

Educators and policymakers have been seeking to increase the number of students 
enrolling and succeeding in college by implementing a variety of interventions at both the high 
school and postsecondary levels. High school-level activities have included efforts such as: 
changing the high school graduation requirements to increase students’ likelihood of completing 
the courses needed for college (Edmunds & McColskey, 2007; Tierney, Bailey, Constantine, 
Finkelstein, & Hurd, 2009); interventions designed to build students’ aspirations to go to college 
and their college readiness skills (Swanson, Mehan, & Hubbard, 1995); expanding access to 


college-level courses through dual enrollment and Advanced Placement (Iatarola, Conger, & 


Long, 2011; Long, Conger, & Iatarola, 2012; Speroni, 2011); and providing assistance to help 
students complete the logistical steps associated with applying to and enrolling in college 
(Castleman, Owen, & Page, 2015; Castleman, Page, & Schooley, 2014). Postsecondary-level 
interventions include tutoring and counseling, financial aid, efforts to increase students’ sense of 
belonging in college, as well as more comprehensive interventions that combine multiple factors, 
such as “living and learning communities” or interventions that couple financial aid with 
required academic supports (Anderson & Goldrick-Rab, 2018; Angrist, Autor, Hudson, & 
Pallais, 2016; Denning, Marx, & Turner, forthcoming; Perna & Leigh, 2018). These 
interventions are primarily targeted at addressing specific student needs and are done within the 
current system that keeps high school and college as separate entities. 

Early college high schools (“early colleges” for short) are a different approach that 
integrates practices designed to promote postsecondary success while combining the high school 
and college experience. Serving students in grades 9 through 12 or 13, early colleges target 
students who are underrepresented in college, such as low-income students, students who are the 
first in their family to go to college, and students who are members of underrepresented racial 
and ethnic minority groups. Early colleges are often located on college campuses, which allows 
students to begin their engagement in the postsecondary experience early. Many students take at 
least one college course as early as 9th grade; by the time students are juniors or seniors in high 
school, most of their courses are college courses, and they spend most of their day interacting 
with other college students. The expectation is that early college students will graduate with both 
a high school diploma and an associate degree or two years of college credit. Thus, students are 
expected to accomplish in four to five years what would normally take them at least six years 


(four years of high school plus two years of postsecondary education). 


The early college model in North Carolina (one of the states to most fully embrace the 
model) has been the subject of a twelve-year longitudinal experimental study that has found a 
variety of positive impacts at both the high school and postsecondary levels. Early college 
students were more likely to successfully complete a college preparatory course of study 
(Edmunds, Arshavsky, & Fesler, 2015; Edmunds, Bernstein, Unlu, Glennie, Willse, et al., 2012). 
They also had higher attendance, fewer suspensions, and were more likely to graduate from high 
school than students in the control group (Edmunds, Bernstein, Unlu, Glennie, Smith, et al., 
2012; Edmunds, Willse, Arshavsky, & Dallas, 2013). Finally, the study found that early college 
students enrolled in postsecondary education at higher rates, and preliminary findings showed 
that they were more likely to receive an associate degree within six years of entering high school 
(Edmunds, Unlu, et al., 2017). The enrollment and associate degree findings were replicated in a 
national study of 10 early colleges (Berger, Turk-Bicakci, Garet, Knudson, & Hoshen, 2014; 
Berger et al., 2013). 

Despite the positive impacts on these outcomes, there are still questions about how well 
this truncated educational experience will serve students once they graduate from the early 
college and pursue additional postsecondary education on their own. Some postsecondary faculty 
may worry that, if the total amount of education time is shortened, students may miss core 
knowledge and skills that are essential for performing well in college. Early college advocates 
may respond that their students will be just as well, if not better, prepared than traditional 
students because of the schools’ emphasis on rigorous instruction, comprehensive supports, and 
early access to college courses. This paper is designed to test these competing hypotheses by 
examining the impact of the early college on students’ performance in postsecondary education 


after they leave the early college. Specifically, we are examining the impact of the early college 


on students’ attainment of a postsecondary credential within six years after 12th grade and on 
their performance in college, as measured by their postsecondary Grade Point Average (GPA). 
Answering these questions will help determine whether a combined high school-college 
experience could serve as a viable path for increasing students’ successful completion of 
postsecondary education. 
CONCEPTUAL FRAMEWORK 
Researchers have argued that students’ success in college is a longitudinal process (Perna 
& Thomas, 2006), driven substantially by the background and experiences they bring with them 
(Tinto, 1993), including their academic knowledge and skills, their organizational and study 
skills, and their cultural capital, which includes an understanding of how to navigate college. We 
begin by examining these factors and then describe how the early college environment is 
designed to address them. We conclude by discussing the unique structure of the early college 
and the potential advantages and disadvantages associated with it. 
Factors Associated with Success in College 
Students’ level of incoming academic achievement and preparation are strongly 
associated with success in college. Students’ grades in high school and scores on standardized 
tests are positively associated with college grades and successful completion of college (ACT 
Inc., 2008; Geiser & Santelices, 2007). Additionally, taking more advanced high school courses 
strongly predicts success in college (Adelman, 2006; Adelman, Daniel, & Berkovits, 2003). 
From at least the early 1900s, colleges themselves have used the type and level of courses that 
students take in high school as an indicator of whether a student is ready for college, expecting 
that students take what is now commonly known as a college preparatory course of study 


(Finkelstein & Fong, 2008; Krug, 1969). In addition to academic content knowledge, researchers 


have also argued that students’ success in college is dependent upon the level of a variety of 
academically-oriented skills including critical thinking, reading and writing effectively, and 
problem-solving (Conley, 2005, 2007, 2008; Edmunds, Arshavsky, et al., 2017). 

Success in college also depends on students’ ability to adapt to a different cultural 
environment that requires students to be able to operate more independently (Hooker & Brand, 
2010). Thus, skills such as time management, organizational management, study skills, the 
ability to collaborate with others, and the ability to advocate for oneself take on increasing 
importance (Byrd & MacDonald, 2005; Conley, 2007), but these are areas in which 
underrepresented populations, such as first generation college-goers, may struggle (Collier & 
Morgan, 2008; Roderick, Nagaoka, & Coca, 2009). Some students come with a better 
understanding of what it means to be a college student, bringing with them the cultural capital 
that comes from their family members’ academic history or parental coaching on how to behave 
and what to expect in college (Collier & Morgan, 2008). 

A third area associated with success in college is students’ ability to navigate the college 
environment, including registering for classes, understanding the process of applying for 
financial aid, and understanding majors and graduation requirements. These are processes that 
can be confusing and unclear, particularly for low-income or first-generation students (Roderick, 
Nagaoka, Coca, & Moeller, 2008). For example, an estimated one in five low-income students 
who were enrolled in college and would have qualified for financial aid never applied for it 
(Roderick et al., 2009). 

As implemented in North Carolina, the early college model intends to prepare students 
for success in college on many of these fronts. The next section describes the early colleges and 


the strategies they use to promote postsecondary success. 


Early College Model 

Early colleges, as studied in this project, are small schools of choice that combine the 
high school and college experiences and are located on college campuses, primarily on 
community college campuses. The schools were purposefully created to prepare all of their 
students for college (Edmunds, 2012), building an environment where “college readiness was not 
something left to chance...”» (Edmunds, Arshavsky, et al., 2017, p. 129). 

To prepare students academically, the early college uses a variety of approaches, two of 
which involve coursetaking. The first approach requires all students to take an honors-level 
college preparatory high school curriculum (North Carolina New Schools, 2013; Thompson & 
Onganga, 2011). This curriculum is intended to ensure that more students complete the courses 
needed for entrance to a four-year university. Results from the existing longitudinal experimental 
study shows that this does happen with a significantly higher proportion of treatment students 
successfully completing a college preparatory course of study (Edmunds, Bernstein, Unlu, 
Glennie, Willse, et al., 2012; Edmunds, Unlu, et al., 2015). Second, early college students 
receive early exposure to college courses, frequently starting in the 9th grade. As students 
progress through the early college model, they take more and more college courses that can help 
them simultaneously meet high school graduation requirements as well as the requirements for 
an associate degree or, for students on a four-year university campus, meet the general education 
requirements of the first two years of college (Berger, Adelman, & Cole, 2010). Results from the 
experimental study show that early college students completed many more college credits while 
in high school than the control group (Edmunds, Unlu, et al., 2017). 

Early colleges implement other strategies that prepare students with the academic and 


other skills necessary for success in postsecondary education. For example, the schools 


emphasize a set of rigorous and relevant instructional practices that required students to engage 
in critical thinking, extensive writing, cooperative work, and ongoing class discussion (Edmunds, 
Arshavsky, et al., 2017; North Carolina New Schools, 2013). As an interviewed early college 
student noted, “writing here at the early college gives you a step above the other college students 
when you get into the English class, because you know what to expect and you’ve already 
written most of these papers that they ask you to do...” (Edmunds, Arshavsky, et al., 2017, p. 
131). 

Early colleges also provide explicit instruction in other skills such as time management, 
note-taking, and study skills. Most of the schools also indicated that they focus specifically on 
teaching students to advocate for themselves with college faculty, scaffolding the experience to 
slowly build students’ ability to communicate effectively with their instructors (Bruce, 2007; 
Edmunds, Arshavsky, et al., 2017). Students are coached through some aspects of the college 
navigation processes, including selecting and registering for their classes, identifying and using 
college resources, and utilizing online course materials, such as Blackboard (Le & Frankfort, 
2011). The early colleges also provide explicit assistance in helping students through the college 
application process, including applying for financial aid (Edmunds, Arshavsky, et al., 2017). 

Finally, the early college model recognizes that the increased expectations must be 
accompanied by increasing support (Jobs for the Future, 2008). As a result, schools focus on 
developing a comprehensive suite of academic and affective supports (Born, 2006; Le & 
Frankfort, 2011). Results reported elsewhere indicate that early college students noted higher 
levels of support than control students (Edmunds et al., 2013). 


The Unique Structure of the Early College 


The early college thus incorporates a comprehensive suite of practices and supports that 


are associated with students’ success in college. Given the model’s components, it is reasonable 
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to expect that the early college will result in increased performance in postsecondary education. 
Nevertheless, as noted earlier, the unique structure of the early college means that high school 
and college are essentially happening at the same time. The end result is that the early college is 
truncating what would normally take six years (four years of high school plus two years of 
college) into either a four or five-year experience. 

This approach builds on a longstanding argument that there is overlap between parts of 
the high school and college experiences that can be consolidated (Krug, 1969; Wechsler, 2001). 
For example, as far back as the early 1900s, Stanford University president David Starr Jordan 
argued that the instruction of college’s first two years “is of necessity elementary and of the same 
general nature as the work of the high school itself’ (McDowell, 1919, p. 18). Nevertheless, the 
idea of combining portions of high school and college never took extensive hold, reflecting 
countervailing beliefs that a full four years of high school were necessary to provide 
comprehensive academic preparation and enrichment (Wechsler, 2001). 

As a result, it is still an open question about whether combining the high school and 
college experience, thereby shortening the two, will provide students with sufficient academic 
preparation to be successful in college. Additionally, if high school students are unsuccessful in 
their college courses, they might be less likely to succeed or be discouraged from future 
postsecondary education. For example, one qualitative study found that early college students 
who had poor performance in a college biology class later lost interest in biology and the 
sciences when they enrolled in the local university (Alaie, 2011). 

This paper examines two competing scenarios relative to the early college. The first 
scenario is that a combined high school and college experience, supplemented by comprehensive 


and purposefully focused practices and supports, can adequately prepare students for further 
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postsecondary education. These supports may especially be instrumental for the postsecondary 
enrollment, persistence, and degree acquisition of first generation college goers and students 
from economically disadvantaged backgrounds. The second scenario is that, despite the 
additional supports, the shortened time spent in a high school/college combination and 
completion of a substantial portion of the first two years of college coursework while in high 
school may result in significant omissions in students’ preparation that would reduce their 
likelihood of success. This adverse effect may be more prevalent for students who would have 
pursued postsecondary education even in the absence of the early college model because these 
students could be missing advanced high school courses they would otherwise have taken. We 
explore these two scenarios by looking at the impact of the early college model on students’ 
attainment of a postsecondary credential and their performance in postsecondary education. 
METHODOLOGY 
This study is based on a multi-site randomized field trial designed to examine the impact of 
early colleges on core student outcomes. The purpose of this paper is to examine the impact of 
the model on students’ performance in postsecondary education. The specific research questions 
are: 
1. What is the impact of the early college on students’ attainment of postsecondary 
credentials? 
2. What is the impact of the early college on students’ postsecondary performance, as 
measured by students’ GPA in four-year institutions? 
3. How do these impacts differ for students who are low-income, first in their family to go 
to college, members of underrepresented minority groups, and students who enter high 


school below grade level? 
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Early colleges included in this study utilized lotteries to select students from an applicant pool, 
and the study compares the students assigned to the treatment group (early college) with students 
assigned to the control group (generally the traditional high school in the district, or “business as 
usual”). This research methodology has been used to look at the majority of impacts from this 
study (Edmunds et al, 2012: Edmunds, Unlu, et al., 2017). 

Analyses estimating the impact of the early college model on postsecondary degree 
attainment were conducted within the experimental framework; however, we were unable to use 
the experimental design for the four-year GPA outcomes for a variety of reasons. First, GPA 
requires transcript-level data, which was only available for students who enrolled in the 
University of North Carolina system. Second, earlier results indicated that early college students 
had higher enrollment than control students in four-year institutions. Both issues indicate that the 
treatment and control group students were likely not comparable; as a result, we chose to use a 
quasi-experimental matching approach within the original randomized sample, described in 
more depth below. 

Sample 

The full study includes 4,054 students who applied to 19 early colleges over a series of 
six years. The first cohort were in 9™ grade in 2005-2006 and the final cohort were in 9" grade in 
2010-2011. The early colleges in our sample are located in rural and urban settings in all regions 
of North Carolina. Schools in the study had to agree to use a lottery to select their students. 
Students applied to the early college and underwent a screening process designed independently 
by each school, resulting in a pool of eligible students. The eligible students were then entered 
into a lottery where students were either offered a spot to attend the early college (treatment 


group) or were not offered a spot and attended the business-as-usual condition, usually the 
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comprehensive high school in the district (control group). Some schools requested that lotteries 
be further stratified by selected student demographic characteristics to accommodate their 
specific priorities, such as ensuring that the school had 80% first generation students or that each 
home high school in the district was sending a number of students proportional to their overall 
population. The sample for each early college was thus a function of the number of eligible 
applicants each school had, the number of slots they were trying to fill, and the extent to which 
any additional stratification reduced the number of students randomized (which might have 
happened if all students in a specific stratum were accepted and therefore had to be excluded 
from the study). 

The 19 early colleges in our sample are only a proportion of the 85 early colleges that 
were in place at the time of these analyses. To explore the representativeness of our sample, we 
looked at the characteristics of the students who were enrolled in our study schools compared to 
students enrolled in other North Carolina early colleges not in our study, and also compared with 
students enrolled in traditional high schools in the same districts as our study sample. As Table 1 
shows, the study schools were similar to other early colleges, although study schools had more 
economically disadvantaged students. In general, the study early colleges had similar socio- 
economic characteristics to their neighboring traditional high schools, except that students in our 
study were more likely to be female, less likely to be identified with a disability, and had higher 
8'* orade academic performance than the average student in their district. 

TABLE | HERE 

Within this overall sample, the specific analytic samples were different for the two 

outcomes and are described along with the outcomes below. 
Measures and Data Sources 


Outcome Measures 
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This study focused on two long-term outcomes: attainment of a postsecondary credential 
and postsecondary Grade Point Average (GPA).” 

Postsecondary credentials. Successfully completing postsecondary education is one of 
the key goals of the early college model. The primary outcome examined for this study is 
attainment of any postsecondary credential including bachelor’s degrees, associate degrees, and 
technical credentials. We present results both for overall attainment of any credential and 
separately for each degree type. We primarily examined students’ attainment of these degrees by 
two time points: four years after completion of 12" grade (what is often described as graduating 
within 100% time for four-year institutions) and six years after completion of 12™ grade (what is 
often described as graduating at 150% time)*. The federal Integrated Postsecondary Education 
Data System (IPEDS) reports six-year graduation rates (Ginder, Kelly-Reid & Mann, 2018). 

The data source for degree attainment is the National Student Clearinghouse 
(Clearinghouse). The Clearinghouse collects data representing approximately 97 percent of 
students enrolled in postsecondary institutions in the United States, including 98 percent of four- 
year institutions and 99 percent of two-year institutions in North Carolina (National Student 
Clearinghouse Research Center, 2019), and provides information about enrollment by semester, 
the institution in which a student is enrolled, and type and date of any degrees received. The 
Clearinghouse linked our applicant data to their files using name and birth date. 

If a student did not have a degree in the Clearinghouse data, we considered him or her not 
to have earned one. We acknowledge that a student could be missing from the Clearinghouse 
data for a variety of reasons beyond non-enrollment or non-degree attainment. The primary other 
reasons include misidentification or a student opting out of sharing his or her data (Dynarski, 


Hemelt, & Hyman, 2015). We undertook various approaches to minimize these reasons, 
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including resubmitting the same list of names for multiple years since students’ permissions can 
change over time (Dynarski et al., 2015) and submitting various spellings of the same name (e.g., 
John, Jon, Jonathan, Jonathon, etc.). While our approach ensures that we have outcome data for 
all randomized students (i.e., virtually no overall or differential attrition) and the outcomes are 
defined in the same way for both treatment and control groups, numerically more treatment 
students may be affected by the incompleteness of degree acquisition data in the Clearinghouse 
if, as we expect, more treatment students enroll in postsecondary education. As a result, our 
impact estimates may be considered conservative. 

The sample used for the postsecondary credential analyses includes a total of 1,687 
students who applied to 12 early colleges in North Carolina from 2005-2006 through 2008-2009. 
This represents the full sample of students for whom we had data through six years after the 
completion of 12" grade. The analytic sample includes 952 treatment and 735 control students. 
The baseline characteristics for the sample are shown in Table 2, which indicates that the 
differences between the treatment and control groups are small and not statistically significant 
for almost all variables, as expected from groups constructed using random assignment. 
Nevertheless, all analyses that compare outcomes of treatment and control students control for all 
of these characteristics. 

TABLE 2 HERE 
Grade Point Average. Although postsecondary credential attainment is the ultimate goal of 
going to college , students may still graduate even if they do not do well academically. In other 
words, any positive impact on graduation rates may mask a lower level of learning. As a result, 
as a measure of how well students performed in courses they took after leaving the early college, 


we examine students’ GPA for all college courses they had taken since entering the UNC system 


ite) 


after graduation from the early college. Specifically, we examine cumulative GPA measures at 
four time points: 1) through two years after 12" grade; 2) through three years after 12" grade; 3) 
through students’ first year at the UNC system, and 4) through students’ second year at the UNC 
system. Cumulative GPA measured at two and three years after 12" grade aims to hold constant 
students’ age and the time after they enrolled in high school while cumulative GPA through the 
first and second year at the UNC system aims to hold constant the time students spent in the 
UNC system. Using multiple measures defined at different time points allows us to examine 
GPA in a comprehensive and flexible manner, accounting for the wide variation across when 
students enrolled in the UNC system. For example, some students enrolled in the UNC system 
right after completing high school while some students enrolled after spending two years in a 
two-year institution. 

Analyses of GPA cannot use the fully randomized sample of students because a given 
grade point measure is only defined for students who enrolled in the UNC system at each time 
point. Additionally, for students who enrolled in a 4-year college outside the UNC system, we 
cannot measure their GPA reliably and set their GPA to missing. Therefore, the analytic sample 
for GPA measured at each of these time points differ according to which students were enrolled 
in the UNC system with course data at that particular time point. Given the relatively large 
proportion of students with missing GPA (between 68 percent and 74 percent), we did not 
impute missing values for this outcome. 

Another factor complicating the GPA analyses was that having a non-missing GPA 
measure could have been directly related to the treatment. For example, cumulative GPA through 
two years after 12" grade was missing for 69 percent of the treatment students while it was 


missing for 76 percent of the control students. This was likely a direct result of the positive 
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impact of the treatment on students’ enrollment in 4-year institutions. Because of the large 
overall and differential missing rates for the GPA measures, we treated these analyses as quasi- 
experimental and employed propensity score weighting methods to conduct the GPA analyses 
with comparable treatment and control students, described in the analysis section below. 

The sample used for the GPA analyses includes students who applied to the 19 study 
early colleges from 2005-2006 through 2010-2011 and enrolled in a UNC campus post high 
school through the spring 2017 semester. The size of the analytic sample varies across the four 
GPA measures, from 1,072 students (674 treatment and 398 control) for cumulative GPA 
through second year of college to 1,292 students (797 treatment and 495 control) GPA through 
first year of college. 

Covariates 

The outcome measures created using the UNC System and National Student 
Clearinghouse data were linked to student application data (which included treatment/control 
status and odds of being selected to the early college) and data from the North Carolina 
Department of Public Instruction (NCDPI). NCDPI data included baseline covariates such as 
demographic characteristics (gender, race/ethnicity), economically disadvantaged status, 8th 
grade achievement scores, and special education status. The propensity score analysis conducted 
for the GPA measures utilized additional measures including 8"-grade absences, teachers’ 
assessment of students reading and math achievement in 8th grade, performance score for the 8°- 
grade school, district-level average high school graduation rates, and number of colleges within 
8"_grade county. All of the data were linked and stored at the North Carolina Education 
Research Data Center housed at Duke University. 


Subgroups 
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Early colleges were specifically designed to increase postsecondary access and success 
for students for whom access to college has historically been problematic. As a result, we 
examined the impact for four different sub-groups. Three of these sub-groups were members of 
the target population for the early college: 1) underrepresented minorities (students who 
identified as African-American, Hispanic/Latino, or Native American); 2) first generation 
college-goers, defined as students whose parents had no exposure to postsecondary (Cataldi, 
Bennett, & Chen, 2018, p. 2); and 3) economically disadvantaged students. The final sub-group 
was students who were not prepared for 9th grade, defined as students who did not pass either 
the reading or math 8" grade end-of-grade exams. This was not a target population for the 
initiative; however, we believed it was important to examine this subgroup since many 
practitioners had concerns about whether lower-performing students could succeed in a model 
that accelerates them quickly into college courses. 

Statistical Methods 
This section first describes our basic approach for analyzing impacts. We then identify how 
this approach had to be modified to look at postsecondary GPA. 
Estimation of Impacts 

Each outcome measure was used as the dependent variable in multivariate regression 
models that included lottery indicators, baseline covariates (demographics and measures of prior 
achievement listed above), and a treatment group indicator, which yielded the estimated impact 
of the early college on that outcome. The analyses reported in the paper were conducted in the 
intent-to-treat (ITT) framework, meaning that the treatment indicator captures the initial random 
assignment status for a given student. We do not report separate treatment-on-the-treated (TOT) 


or local average treatment effect (LATE) estimates as compliance with the initial random 
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assignment status was fairly large (92 percent among treatment students and 99 percent among 
control students). 

As mentioned above, some school-level lotteries were stratified on student demographic 
characteristics which led to different probabilities of being assigned to the treatment group.’ For 
such lotteries, we created weights to account for the unequal treatment assignment probabilities 
and these weights were used in the estimation’ (Imbens and Rubin, 2015; Institute of Education 
Sciences, 2018). We used cluster-robust standard errors calculated based on the early college or 
the regular high school that students attended for the longest period of time. The equation below 


represents a prototypical regression model: 


Y FBT; +L ByS; DBs Xu + gj (1) 
= see 
where Yj is the outcome of interest for student i in lottery 7, 7; is the treatment indicator for 
student 7 in lottery j (7; = 1 if student 7 is assigned to the treatment group; 7; = 0 otherwise), S; is 
a lottery indicator equal to 1 for students who participated in lottery / and to 0 otherwise (j = 
1.../), £7 is the estimated average ITT treatment effect, 2; is the fixed effect for lottery 7 (i.e., the 
average outcome of the control students from lottery 7), Xn is the n-th characteristics of student i 


in lottery 7, which is included as a covariate, £3, represents the relationship between the n-th 


student characteristic and the outcome Y; and & represents the random error term 


For all outcomes, we present the adjusted impact estimate, the unadjusted control mean, and 
an adjusted mean for the treatment group that is calculated by adding the adjusted impact to the 
unadjusted control mean. We also present the cluster-robust standard errors for the impact 
estimates. 

The subgroup analyses were conducted by estimating a similar impact model for each 
subgroup of interest and the rest of the sample (i.e., separate impact models were run for first 
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generation college-goers and non-first generation college-goers). Following Bloom and 
Michalopoulos (2010), we also report whether the impact for a given subgroup is statistically 
significantly different than the impact for the rest of the sample. 
Addressing Missing Values for Outcomes and Covariates 

Relying on administrative data reduced the instances of missing outcome and covariate 
values. We did not impute missing outcome values. To address missing covariate values, we 
used Stata’s multiple imputation module mi (Stata Corp, 2019). Specifically, we utilized multiple 
stochastic imputation by chained equations that included the treatment indicator and outcome 
values. This approach is consistent with the widely accepted best practices in the field and the 
most recent WWC standards. Using Rubin’s rules, our statistical inferences accounted for the 
uncertainty introduced by the imputation procedure (Rubin, 1987). 
Propensity Score Weighting for GPA 

As described under the methodology section, the GPA analyses faced challenges with 
missing data because we only had data for students in the UNC system and because the early 
college had a positive impact on enrollment in postsecondary education. We used a propensity 
score weighting approach to balance the observable characteristics of the treatment and control 
students who had valid GPA to the extent possible. Since there were many more treatment 
students who had a GPA than control students, the weighting process is similar to matching 
control students who have valid GPA with similar treatment students who have valid GPA. 
Therefore, this analysis is expected to yield the effect of early colleges on GPA for students who 
would have enrolled in the UNC system even in the absence of the program. We used weighting 


as it does not require making additional decisions that most matching procedures do (e.g., 
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choosing a radius, whether to match with replacement or not, whether one-to-one or one-to-many 
matching is conducted) (Stuart, 2010).° 

We implemented weighting separately for each of the four GPA measures through a multi- 
step process. The first step was estimation of the propensity scores. In this case, the propensity 
score represents the probability of having a GPA as function of baseline covariates that are 
considered to predict GPA and enrolling in an UNC campus. Our covariates included 
demographics (race/ethnicity, gender, age, economic disadvantage, first generation college going 
status, having a disability, being identified as academically or intellectually gifted), baseline 
indicators of student achievement (being retained in a prior grade, scores in 8th grade math and 
reading end of course exams, and passing Algebra I in 8th grade, teachers’ assessment of 8"- 
grade achievement in math and reading), 8""-grade absences (proxy for academic engagement 
and motivation), and additional factors that we expected to predict enrolling in UNC such as 
academic performance of the 8"-grade middle schools,’ district-level baseline high school 
graduation rates, and number of colleges in the 8""-grade county. We estimated the propensity 
scores using generalized boosted modeling (GBM; McCaffrey et al., 2013). GBM combines 
boosting (i.¢e., iterations) and regression trees (which partition the dataset into numerous regions 
based on the covariate values). GBM is data adaptive and nonparametric; it automatically selects 
which covariates should be included and the best functional form by using many piecewise 
functions of the covariates and testing all possible interactions to achieve the best balance 
between the treatments and comparison units. GBM also accommodates missing values for 
covariates by balancing both the distribution and the rates of missingness of each covariate 
between the treatment and comparison arms. We implemented GBM using the twang package in 


Stata (Cefalu, Liu, and Martin, 2015). 
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The second step was calculating weights for the treatment students with valid GPA measures 


so that they look similar to the control students who have a valid GPA measures. Following 


Stuart (2010), control students are weighted by 1, treatment students are weighted by -. where 


P is the estimated propensity score. 

The final step was assessing baseline equivalence. For each covariate, we examined 
standardized differences (1.e., effect sizes) between the weighted treatment and control students 
(Rosenbaum and Rubin, 1985; Institute of Education Sciences, 2018). We required standardized 
differences to be less than 0.1 standard deviations (SDs) in absolute value for all covariates 
(which is more stringent than the 0.25 SDs threshold adopted by the WWC). 

Table 3 shows the sizes and characteristics of the GPA analysis samples. For each GPA 
measure, we present treatment and control differences before and after weighing. We see that 
there were sizeable differences between the treatment and control students prior to weighting, 
with some differences being greater than 0.2 SDs. Weighing reduced all of these differences 
below 0.10 SDs and made the two groups tightly balanced on observable characteristics. 

TABLE 3 HERE 

To calculate the impact on GPA, we used the analytic model and approach described 

above for the analysis postsecondary credentials. 
RESULTS AND DISCUSSION 

The first research question asked whether early college students were more likely to earn 
a postsecondary credential than control students; we assessed these impacts using the 
randomized controlled trial sample. Our results show that early college students received 
postsecondary credentials at a higher rate than control students: by the end of the fourth year 


after the end of grade 12, 37.8 percent of the treatment group had earned a postsecondary degree 
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compared to 22.0 percent of the control group (see Table 4). This was driven in large part by a 
21.2 percentage point impact on associate degree attainment. 

When we look six years after the end of grade 12, we see that there remains a significant 
impact on overall degree attainment and on associate degree attainment with 44.3 percent of the 
treatment group estimated to have a postsecondary credential compared to 33.0 percent of the 
control group and an impact of 21.8 percentage points on associate degree attainment. As Table 
4 also shows, however, by six years after Grade 12, the control students have essentially caught 
up to the treatment students in four-year degree attainment (24.9 percent treatment vs. 24.0 
percent control). 

TABLE 4 HERE 

Because students could earn both an associate degree and a bachelor’s degree, we also 
analyzed the results by the following mutually exclusive categories: 1) earning only a technical 
certificate, 2) earning only an associate degree; 3) earning only a bachelor’s degree; and 4) 
earning both an associate and bachelor’s degree. These results, also shown in Table 4, provide 
additional support that the mechanism for increased degree attainment is primarily through the 
associate degree route, giving students a credential who would otherwise have not earned one at 
all and also giving students with bachelor’s degrees an additional credential. 

When we look at the results for degree attainment by sub-group (shown in Table 5), we 
see similar results with large positive impacts for associate degree and generally non-significant 
impacts for four-year degree attainment with one exception: there is a statistically significant 
positive impact on four-year degree attainment for economically disadvantaged students. This is 
consistent with the program’s theory of change for removing barriers to degree attainment for 


first generation and low-income students. When we look at differences in impacts between sub- 
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groups, we see larger impacts on two-year degree attainment for the non-targeted groups. We 
speculate that this might be because students in these relatively more advantaged groups might 
otherwise be less likely to attain an associate degree, instead going directly into a four-year 
university. Results for the mutually exclusive categories by sub-group are reported in the 
appendix. 
TABLE 5 HERE 

The findings suggest that the large impact on two-year degree attainment is maintained 
(and even grows slightly) when looking at the time period between four and six years after 12" 
grade. In contrast, the control group appears to be catching up relative to four-year attainment 
with the significant impact at four years essentially disappearing when students are six years out. 
There is, however, an advantage to students completing their degree more quickly—it may end 
up costing students and taxpayers less, and students may be able to more quickly find 
employment. Indeed, one of the goals of the early college is to streamline the high school and 
college experiences, so that students require less time to graduate and can enter the workforce 
more rapidly. As a result, we looked at the time it took students in both treatment and control 
groups to earn a degree. Figure 1 shows both the impact estimates and the timing of two-year and 
four-year degree acquisition by the treatment and control students, respectively. These figures 
not only show that a larger number of treatment students have obtained two- and four-year 
degrees than control students (which is consistent with the positive impact estimates shown in 
Table 4), but they also indicate that treatment students obtained their degrees at a faster pace than 
control students. Our analyses found that treatment students who earned an associate degree did 
SO approximately two years earlier than the control students. Treatment students who earned a 


bachelor’s degree did so approximately half a year earlier than control students. 
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FIGURE 1 HERE 

Our results show that the early college is having a large and sustained impact on associate 
degree attainment and that students are earning a four-year degree more rapidly. Nevertheless, 
some educators and policymakers may argue that the shortened time to degree means that 
students are missing time to develop key content and skills. While the final test of this will be 
students’ success in the workplace, students’ GPA in college courses give a preliminary 
indication of whether students are missing key skills. Table 6 shows impacts on student 
performance on cumulative GPA at four different time points (two and three years after 12" 
grade, and the first and second years in college). As noted above, the first two analyses control 
for the time since starting high school, while the second set (GPA in the first and second years of 
college) control for the time enrolled in the university system. As the table shows, early college 
students performed the same as control students. Among the four measures, the estimated 
impacts on all outcomes were small in magnitude and not statistically significant. These findings 
suggest that those treatment students who would have enrolled in the UNC system even in the 
absence of the early college model were just as prepared as control students but did not have a 
substantial advantage relative to academic preparation post high school. 

TABLE 6 HERE 

As explained above, these results are considered as quasi-experimental and rely on 
observable covariates capturing all of the confounders of GPA and going to a UNC campus; 
therefore, we tested their robustness to unobserved confounders using the sensitivity analysis 
framework introduced by Oster (2013, 2017). The appendix includes a discussion of the 


sensitivity analyses and the findings. 
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Although these results suggest that early college students are just as well, if not better, 
prepared than students who attended traditional high schools, there are several factors to consider 
in interpreting the GPA findings. First, despite the fact that GPA is a common and acceptable 
measure of postsecondary performance (Institute of Education Sciences, 2016), GPA may differ 
across colleges and across subject areas (Arcidiacono, Aucejo, & Spenner, 2012; Conger & 
Long, 2010). Future research will explore the impact of the early college on major selection and 
on enrollment in specific courses. Additionally, because early college students earn more credits 
in high school and often enroll at a more advanced level, they may enter a postsecondary 
institution taking courses that students might take later in college; research has suggested that 
GPA in higher level courses tends to be higher and have less variation (Arcidiacono, Aucejo, & 
Spenner, 2012; Grove & Wasserman, 2004). Our measurement of GPA two years and three years 
after 12" grade should account for this to a certain degree but may not fully account for it given 
that other research we have done has shown that early college students have earned more college 
credits by those points in time (Edmunds et al, 2017). 

CONCLUSION 

The early college model is a new model of schooling that combines the high school and 
college experiences, explicitly focusing on practices and structures that are intended to increase 
students’ success in college while also shortening the amount of time that students spend in the 
educational system. Essentially, the early college model is a test case of whether we can 
restructure the educational system in a way that embeds attainment of postsecondary credentials 
into high school. 

At the beginning of the article, we postulated two different scenarios—one where the 


practices and supports prepare early college students for postsecondary success, and one where 
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the shortened time results in indirect and adverse effects on students once they leave the early 
college setting. Our results show that neither hypothesis is entirely correct. Results show no 
systematic impact on students’ college GPA, suggesting that students did not appear to enter the 
four-year institution with either an academic advantage or disadvantage from their early college 
experience. Thus, the acceleration that they received was not counter-balanced by a negative 
impact on their preparation. Future work should examine GPA in light of course selections of 
early college graduates compared with traditional high school graduates. 

Results did show, however, that early colleges had a positive impact on the percentage of 
students receiving a postsecondary credential. The increase was driven in large part by increased 
attainment of associate degrees, much of which was happening while students were in the early 
college. There was also a positive impact, however, on attainment of bachelor’s degrees earned 
within four years after 12" grade, although control students had essentially caught up by six 
years after 12" grade. Time-to-degree analyses do indicate that treatment students who earned 
degrees did so more rapidly than control students. One likely explanation is that the number of 
college credits a student receives serves as form of momentum to accomplish their degree; in 
other research, we have shown that treatment students earned a much higher number of college 
credits while in high school (Edmunds, Unlu at al, 2017). Graduating more quickly may mean 
these students became less encumbered by student loan debt and were able to enter the 
workforce more quickly. Future research should examine the economic stability of early college 
high school graduates compared with those from traditional high schools. 

When looking at the impact on credential attainment for sub-groups, we see positive 
impacts for all groups, which indicates that the treatment benefitted all types of students. 


Looking at the increases, however, there are differential impacts by sub-group and by degree 
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level. Relative to associate degree attainment, we see that the treatment had a larger impact on 
students who faced fewer challenges (e.g., non-economically disadvantaged students, non- 
minority students, non-first generation students, more academically prepared students). We 
believe these results are an artifact of the early college’s unique design. Because students can 
earn an associate degree as part of the program, it is highly likely that students who earn this 
degree might not have otherwise considered it because they would have gone straight to a four- 
year institution. Yet, it does not appear that the early college is necessarily redirecting students 
from a four-year to a two-year, given that we also have small positive impacts on bachelor’s 
degrees. We also see that the impact on four-year degrees was higher for economically 
disadvantaged students and similar for minority students. These results run counter to recent 
findings that have found smaller impacts of dual enrollment efforts for low-income students, 
driven in large part by lower academic preparation (Miller et al., 2018). It is possible that the 
additional supports that are embedded in the early college, and that are often missing from dual 
enrollment programs in traditional high schools, are providing the extra support that low-income 
students need to complete their degrees. The early college study thus provides evidence that 
some students can benefit from a system that combines both the high school and college 
experiences. At this point, there appears to be little disadvantage to the acceleration that arises 
from this unique approach and quite a few advantages. It also suggests that early college may 
serve as a model to help close gaps in degree attainment, particularly for low-income students. 


NOTES 


' The research reported here was supported by the Institute of Education Sciences, U.S. 
Department of Education, through Grants R305R060022, R305A110085, R305A140361 and 


R305H190036 and by a grant from Arnold Ventures to the University of North Carolina at 
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Greensboro. The views expressed here are of the authors and do not reflect those of the Institute 


of Education Sciences, the U.S. Department of Education, or Arnold Ventures. 


2 Some readers may wonder why participation in developmental education is not included as an 
outcome. The postsecondary institutions within the University of North Carolina System do not 
routinely report students’ remedial coursework. In the dataset we received, the system’s 
remedial course flag identified 52 out of 22,835 courses as remedial. The data programming staff 
at the University of North Carolina System indicated there were no other ways to identify 
remedial courses. We contacted registrars at individual institutions and learned that many of 
them found alternative ways to get their students to take remedial classes without labeling them 
as “remedial”, such as having their students take courses at a local community college. Because 
we were not able to get reliable data on remedial course taking, we were not able to analyze 


remedial course placement as an outcome. 


>The time points included in our study (““X” years after 12th grade) are intended to reference the 
typical student who would have completed 12 grade on time. Thus, students who were retained 
at some point in high school would still be included in the cohort of students who would 
otherwise be completing 12th grade. This time point is also intended to be the typical end point 
for high school graduation but it is important to note that many early colleges had five year 
programs, thus many treatment students graduated from high school a year later than their 


control counterparts. 


4 Within the full sample, the treatment assignment probability varied between 14% and 90%, 


with the interquartile range covering 42% to 72%. It is important to remember that all treatment 
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students within an individual early college may not have the same probability of assignment, 


given that some schools had additional strata within which lotteries were conducted. 


> If unaccounted for, such differences in treatment assignment probabilities would lead to 
unbalances between the treatment and control groups. In our weighting schemes, each 
observation’s weight was proportional to the inverse of the probability of its assignment to its 
respective groups. That is, treatment weights were proportional to 1/P(T=1|X) and control 
weights were proportional to 1/(1-P(T=1|X) where P(T=1|X) represents the treatment assignment 
probability conditional on the covariate vector X. Weights were calibrated to so that the 


weighted sample size equaled the original sample size. 


Nevertheless, we also implemented radius and one-to-one matching procedures, which yielded 
very similar results to those from the weighting procedure. For simplicity we do not present these 


additional results here, but they are available upon request. 


7 We used the performance composite scores calculated by North Carolina Department of Public 
Instruction which reflects the percent of test scores in the school at or above “grade-level 


proficiency.” 
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Figures and Tables 


Table 1: Representativeness of the Early Colleges in the Analytic Sample 


Students in traditional 
Students in Study Students in other high schools in study 
Schools Early Colleges districts 
(N=3433°) (N=11,118) (N=89,089) 

Race & Ethnicity 

American Indian 1.66% 3.28% 2.47% 

Asian 0.55% 1.98% 0.73% 

Black 25.87% 24.85% 31.72% 

Hispanic 10.05% 9.35% 8.18% 

Multiracial 3.73% 2.99% 3.20% 

White 58.11% 57.36% 53.64% 
Gender 

Male 41.56% 39.39% 52.47% 
Age 15.23 15.23 15.35 
Socioeconomic Background 
Economically disadvantaged 41.45% 35.23% 43.60% 
Exceptionality 

Disabled/Impaired 4.10% 4.21% 13.35% 

Gifted 18.67% 16.60% 14.07% 
8th Grade Achievement 

Math <"7 score 0.48 0.48 0.01 

Reading - Z score 0.52 0.49 0.15 


@The demographics for students in the study schools include students who were enrolled in a study school but who 
may not have been in the study sample (1.e., they were admitted through a non-random process). 
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Table 2. Sample Characteristics, by Treatment Status? 


Whole Treatment Control 
Sample Group Group T-C Difference 
(N=1687) (N=952) (N=735) 
Mean Mean Mean Difference P-Value 

Race & Ethnicity 

American Indian 0.80% 0.79% 0.81% -0.03% 0.953 -0.02 

Asian 0.92% 1.01% 0.81% 0.20% 0.671 0.14 

Black 26.53% 27.32% 25.50% 1.82% 0.406 0.06 

Hispanic 8.26% 9.18% 7.05% 2.13% 0.119 0.17 

Multi racial 3.12% 2.48% 3.95% -1.47% 0.089 -0.29 

White 60.38% 59.22% 61.88% -2.66% 0.273 -0.07 
Gender 

Male 40.87% 40.56% 41.27% -0.71% 0.770 -0.02 
Age as of Spring, Grade 9 15.36 15.34 15.38 -0.04 0.068 -0.09 
Socioeconomic Background 

First Generation College 40.83% 41.08% 40.50% 0.58% 0.816 0.01 

Economically 
Disadvantaged 50.69% 51.34% 49.86% 1.48% 0.561 0.04 
Exceptionality 

Disabled/Impaired 2.88% 2.43% 3.51% -1.07% 0.211 -0.23 

Gifted 14.75% 13.89% 15.93% -2.04% 0.259 -0.09 
Retained before 0” giade 4.10% 3.10% 5.45% 2.35% 0.01* -0.37 
8th Grade Achievement 

Math - Z score 0.00 -0.03 0.03 -0.06 0.225 -0.06 

Reading - Z score -0.01 -0.02 0.01 -0.03 0.519 -0.03 


Notes: “ The proportions are weighted by students’ probability of being selected into the ECHS. 


*Statistically significant at p<.05. 
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Table 3. Balance of the Weighted Control and Treatment Students with Valid GPA, Before and After Weighting 


Cumulative GPA through 


Cumulative GPA through 


Cumulative GPA through 


Cumulative GPA through 


8 Grade Reading Score 


-0.113 


0.039 


-0.097 


0.032 


Grade 14 Grade 15 First Year in UNC System Second Year in UNC 
(732 treatment & 408 (792 treatment & 463 (797 treatment & 495 (674 treatment & 398 control) 
control) control) control) 
Before After Before After Before After Before After 
Black -0.005 -0.063 0.017 -0.024 0.003 -0.019 0 -0.05 
White 0.007 0.069 -0.019 0.044 0.013 0.058 0.009 0.059 
Hispanic 0.035 0.024 0.049 -0.005 0.018 -0.028 0.04 0.041 
American Indian -0.012 0.009 -0.019 -0.03 -0.014 -0.021 -0.067 -0.072 
Multi-race -0.068 -0.078 -0.044 -0.032 -0.05 -0.044 -0.05 -0.046 
Male -0.019 0.024 -0.026 0.024 -0.02 0.021 -0.014 0.032 
First Generation College Goer 0.017 0.035 0.053 0.037 0.047 0.02 0.023 0.02 
Economically Disadvantaged 0.116 0.087 0.133 0.045 0.149 0.049 0.143 0.054 
Gifted -0.185 -0.077 -0.127 -0.022 -0.123 -0.024 -0.131 -0.045 
Has Disabilit -0.141 -0.092 -0.128 -0.076 -0.135 -0.07 -0.156 -0.084 
Age 0.029 0.029 0.068 0.026 0.09 0.032 0.07 0.055 
ae eee -0.07 -0.057 -0.039 -0.035 -0.034 -0.033 -0.041 -0.037 
Passed Algebra I in Grade 8 -0.103 -0.025 -0.096 -0.022 -0.087 -0.021 -0.082 -0.025 


-0.079 


0.034 


Grade County 


8 Grade Math Score -0.169 0.001 0.151 0.018 -0.101 0.025 -0.106 0.007 
7 Grade Reading Score 0.157 -0.01 0.135 0.031 0.122 0.029 -0.13 0.013 
7 Grade Math Score 0.288 -0.058 0.27 -0.028 0.229 -0.036 0.219 -0.05 
Teacher Judgement of Reading 

Ability (8% Grade) -0.076 0 -0.081 0.012 -0.076 0.013 -0.1 -0.009 
Teacher Judgement of Math 

Ability (8% Grade) -0.046 0.052 -0.051 0.06 -0.059 0.044 -0.027 0.063 
8™ Grade Absences 0 -0.019 0.007 -0.023 0.008 -0.016 0.005 0.021 
Festormince Sore 10r-ai -0.083 0.001 -0.079 0.016 -0.058 0.026 -0.086 0.002 
grade school 

District 4 Year Graduation Rate 0.177 -0.05 0.168 -0.033 0.163 -0.041 0.165 -0.038 
Number oe alleges within Bil 0.117 0.001 0.111 -0.038 0.075 -0.04 0.095 -0.009 


Notes: The standardized difference for a given measure is calculated by dividing the treatment-control difference by the pooled standard deviation of that 


measure. Grade seven and eight test scores are from End of Grade tests administered to all students in North Carolina. 


38 


Table 4: Impact of the Early College Model on Attainment of a Postsecondary Credential 


N = see ‘ Unadjusted Impact Estimate 
Méaa Control Mean (Standard Error) 
Attainment of any Postsecondary credential by 1687 6 7 15.8%** 
4 Years after Completion of 12 Grade oun ue 3.3) 
1687 9 9 0% 
Attainment of technical credential ae ai (0.9) 
1687 ‘ ‘ 21.2%** 
Attainment of associate degree aes ‘ee (3.1) 
1687 9 9 3.9%* 
Attainment of bachelor’s degree nee ee (1.9) 
Attainment of any Postsecondary credential by 1687 44.3% 33.0% 11.3%** 
6 Years after Completion of 12 Grade ee ita (2.9) 
1687 0 0 0.4% 
Attainment of technical credential 208 ae (1.0) 
1 687 0 0 21 . 8%* 
Attainment of associate degree sues ou (2.9) 
1687 0 0 0.9% 
Attainment of bachelor’s degree ae Ae (2.2) 
Attainment of Postsecondary Credentials by 6 Years after Completion of 12" grade 
(Mutually exclusive categories) 
1687 0 0 0.0% 
Earning only a technical credential Le ae (0.7) 
1687 0 0 10.3%** 
Earning only an associate degree ae a (1.6) 
1687 ‘i 3 -10.6%** 
Earning only a bachelor’s degree sake een (2.5) 
Earning both an associate and bachelor’s 1687 15.3% 3.8% 11.5%** 
degree 1.9) 


Notes: Adjusted treatment group mean is obtained by adding the impact estimate to the unadjusted control group 
mean. Statistical inference is conducted based on cluster-robust standard errors calculated according to the high 
school students were enrolled the longest. * significant at p<.05; **significant at p<.001. 
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Table 5: Impact of the Early College Model on Attainment of a Postsecondary Credential, 


by Subgroup 


N . ae ‘ Unadjusted Impact Estimate 
es Control Mean (Standard Error) 
Attainment of Any Degree by 6 Years after Completion of 12" Grade 
ae 8.9%* 
Underrepresented minority 582 36.1% 27.2% (3.4) 
er 13.3%** 
Non-underrepresented minority 1071 49.1% 35.8% (3.2) 
Differential impact “4.4% 
“a if (4.7) 
. ; 11.5%* 
First generation college-goers 652 36.1% 24.6% (4.3) 
; 12.2%* 
Non-first generation college-goers 956 51.9% 39.7% (3.6) 
Differential impact -0.7% 
fe is (5.6) 
; F 12.9%* 
Economically disadvantaged 790 35.9% 23% (4.6) 
. i 11.1%* 
Non-economically disadvantaged 779 53.6% 42.5% 3.4) 
Differential impact 1.8% 
4 is (5.7) 
5.1% 
Underprepared students 481 24.6% 19.5% (3.6) 
O/ 
Prepared students 1088 54% 40.2% me ; 
. ae -8.7% 
Differential impact (5.0) 
Attainment of Associate Degree by 6 Years after Completion of 12'" Grade 
0/ 
Underrepresented minority 582 20.9% 5.9% “6 A 
ea tae 26.6%** 
Non-underrepresented minority 1071 39.8% 13.2% G.1) 
Differential impact -11.6%* 
i i (4.7) 
: é 16.7%** 
First generation college-goers 652 26.5% 9.8% (3.4) 
; 26.2% ** 
Non-first generation college-goers 956 38.0% 11.8% (3.4) 
Differential impact ae 
; j 15.0%** 
Economically disadvantaged 790 22.9% 7.9% (4.1) 
: ; 28.6%** 
Non-economically disadvantaged 779 42.5% 13.9% (3.6) 
Differential impact ee 
6.2%* 
Underprepared students 481 13.5% 7.3% (2.5) 
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0/ 
Prepared students 1088 42.8% 12.9% el A 
Differential impact -23.7%** 
(4.1) 
Attainment of Bachelor’s Degree by 6 Years after Completion of 12" Grade 
0 
Underrepresented minority 582 25.0% 23.2% aa 
ee 1.0% 
Non-underrepresented minority 1071 25.1% 24.1% a4 
0 
Differential impact a i 
: : 0.6% 
First generation college-goers 652 17.0% 16.4% (2.6) 
0 
Non-first generation college-goers 956 31.5% 29.8% ’ 
_1 19 
Differential impact nis 
. : 4.5%* 
Economically disadvantaged 790 21.3% 16.8% (2.2) 
_1.90 
Non-economically disadvantaged 779 29.4% 30.6% ao 
0 
Differential impact 7s 
1.2% 
Underprepared students 481 13.3% 12.1% (3.0) 
0 
Prepared students 1088 30.1% 30.1% a x 
: are 1.2% 
Differential impact (4.0) 


Notes: Adjusted treatment group mean is obtained by adding the impact estimate to the unadjusted control group 
mean. Statistical inference is conducted based on cluster-robust standard errors calculated according to the high 
school students were enrolled the longest. * significant at p<.05; **significant at p<.001. 
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Table 6: Impact on Cumulative GPA 


Adjusted Unadjusted fagaet Effect Size 
Treatment N Control N P (Standard 
Estimate 

Time point Mean Mean Error) 
Through 2 Years after 0.09 
Completion of 12‘ Grade 200 ine ae a08 ove (0.07) 
Through 3 Years after 0.03 
Completion of 12‘ Grade oe ae as fe Oe (0.05) 
First Year in College 2.67 797 2.63 495 0.04 0.04 (0.05) 
Second Year in College 2.74 674 2.76 398 -0.02 -0.03 (0.04) 


Notes: Adjusted treatment group mean is obtained by adding the impact estimate to the unadjusted control group 
mean. Effect sizes for the impact estimates are presented in brackets and calculated by dividing the impact estimates 
by the pooled standard deviation. Statistical inference is conducted based on cluster-robust standard errors calculated 
according to the high school students were enrolled the longest. 
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Figure 1: Attainment of Postsecondary Credential over time, by treatment status and by 
level of degree 
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Note: The estimates in this figure are cumulative and reflect the percentage of students earning 
the specific credential by a given number of years since Grade 12. 
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Appendices 


Table A-1: Impact of the Early College Model on Attainment of a Postsecondary 
Credential, by Subgroup (Mutually exclusive categories) 


: Impact 
N - cw, Unadjusted Estimate 
Nea Control Mean (Standard 
Error) 
Attainment of only Associate Degree by 6 Years after Completion of 12 Grade 
6.6%** 
0 0 
Underrepresented minority isa cia ae (1.9) 
12.5%** 
0 0 
Non-underrepresented minority we eae me (2.1) 
-5.9%* 
Differential impact (2.8) 
10.1%** 
0 0 
First generation college-goers On and oe (2.3) 
956 18.7% 7.7% ie 
Non-first generation college-goers dare es (2.4) 
-0.9% 
Differential impact (3.3) 
790 11.2% 5.9% as 
Economically disadvantaged ae Sie (2.0) 
779 23.7% 8.5% pe 
Non-economically disadvantaged a — (2.1) 
-9.9%* 
Differential impact (2.9) 
3.6% 
0 0 
Underprepared students os aa ave (2.1) 
13.8%** 
0 0 
Prepared students ues zee ae (2.2) 
-10.2%* 
Differential impact (3.0) 
Attainment of only Bachelor’s Degree by 6 Years after Completion of 12 Grade 
-6.6% 
0 0 
Underrepresented minority ate meas mena (3.9) 
ocd 1071 7.2% 20.3% ee 
Non-underrepresented minority ; ; (2.7) 
6.5% 
Differential impact (4.7) 
-6.1%* 
0 0 
First generation college-goers bee oe ae (2.7) 
956 12.3% 25.8% oat 
Non-first generation college-goers ; ; (3.4) 
7.4%* 
Differential impact (4.3) 
-5.2% 
0 0 
Economically disadvantaged es oe nee (2.0) 
779 10.6% 25.1% oe 
Non-economically disadvantaged ; ; (3.8) 
9.3%* 
Differential impact (4.3) 
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Impact 


N Es nus Unadjusted Estimate 
Mean Control Mean (Standard 
‘ Error) 
-1.4% 
iy) 0) 
Underprepared students ae ite mee (3.2) 
-16.1%** 
i) 0) 
Prepared students 1088 2 Au 25-278 2.7 
p 
14.7%** 
Differential impact 4.2 
Lp. 
Attainment of both Associate and Bachelor’s Degree by 6 Years after Completion of 12" Grade 
8.4%** 
0) 0 
Underrepresented minorit ae ee aa 2:2: 
p y 
14.0%** 
0 0 
Non-underrepresented minorit we eae ae 2.1 
p y 
-5.6% 
Differential impact (3.0) 
6.6%* 
0 0 
First generation college-goers p32 Oe ae 2.2 
g ge-g 
15.2%** 
0) 0) 
Non-first generation college-goers oe Pes ae 2.2 
g e-8) 
-8.6%* 
Differential impact 3.1 
ip 
9.7%** 
0 0 
Economically disadvantaged a nae ote 2.6 
y g 
13.3%** 
0 0) 
Non-economically disadvantaged ue die ag 2.7 
y g 
-3.6% 
Differential impact (3.7) 
2.6%* 
0 0) 
Underprepared students 40] tas ie (1.3) 
16.1%** 
0 0 
Prepared students Hse aL uae (2.1) 
-13.5%** 
Differential impact (2.5) 


Notes: Adjusted treatment group mean is obtained by adding the impact estimate to the unadjusted control group 
mean. Statistical inference is conducted based on cluster-robust standard errors calculated according to the high 
school students were enrolled the longest. * significant at p<.05; **significant at p<.001. 
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Sensitivity Analysis for Estimated Early College Effects on GPA 

We assessed the sensitivity of the estimated effects of early colleges on GPA to unobserved 
confounders using the framework developed by Oster (2017). This framework utilizes the 
estimated effects and R? values from the regression model that includes all covariates 
(“controlled model”) and from an alternative model that does not include any covariates 
(“uncontrolled model”) and considers two quantities: 

e The adjusted effect estimate for a hypothetical omitted confounder: The adjustment 
utilizes two inputs: R?max which represents the R-squared from a hypothetical regression 
that includes all observed covariates and an unobserved confounders. We set this 
parameter to 1 (the maximum value it can get) and to 1.5 and 2 times of the R-squared 
from the regression with only the observed covariates. The second parameter is the 
coefficient of proportionality (denoted by “delta”), which represents the importance of the 
unobserved confounder for selection relative to the observed covariates. Following Oster 
(2017), we set this parameter to 1 corresponding to the case of “equal selection”. 

e The coefficient of proportionality for which the adjusted estimated effect is zero: Here 
we calculate the delta value corresponding to an omitted confounder which would bring 
the adjusted effect to zero for each of the three R’max values described above. 

Table A.2 shows these two quantities for the four GPA measures as well as the estimated effects 
from the controlled and uncontrolled regressions. An important observation in this table is that 
the effect estimate from the uncontrolled regression is smaller than the estimate from the 
controlled regression for all measures. This suggests a case of negative selection where students 
who self-selected into the treatment had lower values of the covariates that predict the outcome 


(e.g., baseline achievement). Therefore, when we adjust the estimated effect for an equally 
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predictive unobserved confounder in the same direction (e.g., motivation), we get a larger effect. 
Similarly, Table A.2 also shows that only an unobserved confounder that operates in the opposite 
direction of the observed covariates can bring the estimated effects to zero. Since most of the 
unobserved confounders we would worry about in this context (e.g., motivation, family 
engagement, ability, grit) would be positively correlated with the most predictive observed 
covariates (e.g., baseline achievement) and we have do not have any evidence that suggests the 
presence of an unobserved confounder that is related to the outcome in the opposite direction of 
the observed covariates, we conclude that the results discussed in the main text that the early 
college students’ GPA is not different than (or at least as good as) the control students is robust 
to a potential unobserved confounders. If anything, the sensitivity analysis results suggest that 


our estimates may be underestimated. 
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Table A.2 Sensitivity Analysis Results 


troll Adjusted Effect fe lection Bi 
Controlled Model eres aM adjusted che errant Delta for Effect=0, Given R? 
Cumulative GPA 
R’max=1 . R?max=2 R?max=1 . R?max=2 
Effect R2? Effect R2 : R2 R?max=1 Rex : R2 R?max=1 
Through 2 years 
after grade 12 0.07 0.183 0.030 0.105 0.139 0.414 -2.29 -1.154 -0.261 
Through 3 years 
after grade 12 0.03 0.169 -0.010 0.059 0.088 0.365 -1.103 -0.552 -0.112 
First Year 0.04 0.141 -0.003 0.071 0.102 0.501 -1.417 -0.71 -0.116 
Second Year -0.02 0.178 -0.050 0.012 0.043 0.319 0.61 0.305 0.066 
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